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One  of  the  principal  maneuvers  available  for  proving  existence 
theorems  is  to  establish  that  the  desired  point  is  where  a  continuous 
real -valued  function  achieves  an  extremum  on  a  compact  set.  If  the 
extremum  sought  is  an  infimum,  then  the  functional  need  only  be  lower 
semicontinuous .  We  may  take  as  the  definition  of  this  term  for  a 
functional  cp  that  each  set  of  the  form  {x  :  cp(x)  <  c}  is  closed. 

The  crux  of  an  existence  proof  along  these  lines  would  then  be  the 
definition  of  an  appropriate  topology  in  which  the  functional  is  lower 
semicontinuous  and  the  set  compact.  This  idea  is  applied  here  to 
several  problems  involving  convex  functionals.  Applications  to 
Tchebycheff  approximation  and  to  control  theory  are  cited.  Several 
theorems  dealing  with  the  characterization  of  extremal  points  are  given 
as  well. 

Our  terminology  follows  that  of  the  treatise  of  Dunford  and 
Schwartz  [1]  except  that  we  retain  the  older  terms  weak  and  weak* 
topology.  The  weak  topology  in  a  locally  convex  space  E  is  defined 
by  saying  that  a  net  x^  converges  to  x  if  and  only  if  <f  ,xa>  -  <f  ,x> 
for  all  fcE*.  Here  E*  denotes  the  space  of  all  continuous  linear 
functionals  on  E.  The  weak*  topology  in  E*  is  defined  by  saying  that 
a  net  f  converges  to  f  if  and  only  if  (fa,x}  -»  (f,x)  for  all 
xcE. 

Si.  Theorem.  A  continuous  convex  functional  defined  on  an 
open  convex  set  in  a  linear  topological  space  is  the  supremum 
of  a  family  of  continuous  affine  functions. 
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Proof.  Let  cp  be  such  a  functional,  G  its  domain,  E  the  linear 
space,  and  R  the  reals.  In  EfiR  consider  the  upper  graph  set  of  cp! 

K  =  {(x,X)  :  xeG,  X«R,  X  >  cp(x)}. 

Since  cp  is  upper  semicontinuous ,  K  has  an  interior j  since  cp  is 
convex,  K  is  convex;  since  K  is  lower  semicontinuous,  K  is  closed. 
By  [2 ,  page  72 ,  Corollary] ,  K  is  the  intersection  of  a  family  of  half 
spaces  ,  say 

H  =  {(x,\)  :  f  (x)  -  c  X  <  dj 
a  a  a  -  a 

where  a  is  from  some  index  set  A.  We  note  first  that  c  >0,  for 

in  the  contrary  case,  with  fixed  x  and  large  X,  (x,X)  will  lie  in 

K  but  not  in  H^.  Let  A+  =  [acA  :  c^  >  0] ,  and  let  x  be  arbitrary 

in  G.  Then  the  inequality  X  >  cp(x)  implies  the  inequalities 

f  (x)  -  c  X  <  d  for  all  aeA+.  Conversely,  if  f  (x)  -  c  X  <  d  for 

a  oc  oc  ot  oc  oc 

all  a«A+  while  X  <  cp(x) ,  then  (x,X)  i  K  and  consequently 

f.(x)  -  c„X  >  d  for  some  p»A.  Clearly  f^A+.  Thus  c„  =  0.  Hence 

P  P  P  P 

fQ(x)  >  d  .  But  (x,cp(x))«K  and  so  fQ(x)  <  d  ,  a  contradiction.  We 
P  P  P  ~  P 

have  therefore  shown  that 

X  >  cp(x)  f  (x)  -  c  X  <  d  (oeA+) 

-  T  a  a  -  a 

Hence  cp(x)  =  sup  c  ^Cf  (x)  -  d  ]. 

T  ,+  a  a  a 

aeA 

§2.  Definition.  The  c-level  set  of  a  functional  cp  is  the 
set  {x  :  <p(x)  <  c] . 


.  A  lower  semicontinuous  functional  defined  on  a  locally 
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convex  space  and  having  convex  level  sets  is  weakly  lower 
semicontinuous . 

Proof.  Each  set  Mc  =  [x  :  cp(x)  <  c}  is  closed  and  convex,  hence  by  [1, 
page  422,  theorem  13]  weakly  closed.  Thus  ep  is  weakly  lower  semicontinuous. | 

§4.  Lemma.  A  convex  functional  defined  on  a  linear  topological 
space  and  having  two  bounded  non-void  level  sets  has  all  of  its 
level  sets  bounded. 

Proof.  Let  cp  be  such  a  functional.  By  hypothesis  there  exists  a 

number  a  such  that  the  set  S  =  {x  :  cp(x)  <  a}  is  bounded  and  non-void 

and  contains  a  point  Xq  with  cp(xQ)  <  a.  Let  b  =  a  -  cpCx^).  The 

functional  $(x)  =  cp(x)  -  tp(xQ)  is  convex  and  satisfies  $(xq)  = 

Furthermore  S  =  {x  :  $(x)  <  b}.  Let  M  be  an  arbitrary  level  set  of 

$,  say  M  =  {x  :  i(x)  <  c}.  If  c  <  b  then  M  C  s  and  M  is  bounded. 

If  c  >  b  then  0  <  -  <  1.  Hence  for  arbitrary  xeM, 
c 

J(-  x  +  — -  x  )  <  -  $(x)  <  b 
c  c  0  —  c  — 

Thus  the  point  —  x  +  c  —  x  lies  in  S,  and  x  lies  in  a  set  of  the 

c  c  o 

form  Ax  +  pS,  with  A  and  p  independent  of  x. | 


Remark .  It  was  pointed  out  by  R.  T.  Rockafellar  that  the  conclusion 

requires  only  one  bounded  non— void  level  set  in  a  finite-dimensional 

setting.  An  example  due  to  him  showing  the  necessity  of  two  bounded  level 

2  Xn  2 

sets  in  general  is  an  follows:  In  ^  let  cp(x)  =  .  Then 


{x  :  <p(x)  <  0}  =  {0},  but  {x  :  cp(x)  <  l}  contains,  for  each  n, 


the 
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th 

point  (0,. . . ,0,n,0,.. .)  having  n  for  its  n  coordinate. 

§5.  Definition.  Given  a  real-valued  function  cp  defined  on 

a  set  M,  the  co-topology  of  M  has  for  a  subbase  all  sets 

of  the  form  M  =  {x  :  cp(x)  >  c}. 
c 

§6.  Theorem.  9  achieves  its  infimum  on  M  if  and  only  if 
M  is  compact  in  the  cp-topology. 

Proof.  Evidently  cp  is  lower  semicontinuous  in  the  cp-topology.  Hence 
if  M  is  compact  cp  will  achieve  its  infimum.  For  the  converse,  suppose 
that  cp  achieves  its  infimum  p  at  xq.  We  show  M  compact.  By 
Alexander's  theorem  [3,  page  139]  it  suffices  to  show  that  any  cover  by 
subbase  elements  has  a  finite  subcover.  Suppose  then  that  M  c  U{M^  :  AeA} 
where  A  is  a  set  of  reals.  We  will  be  finished  if  there  is  a  A^eA 
such  that  A  <  p,  for  the  HCM.  .  If  no  such  A  exists  then 

O  A.^  O 

A  >  p  for  all  AeA.  But  then  cp(xQ)  >  p,  a  contradiction.  | 

§7.  Existence  Theorem.  Let  E  be  a  reflexive  Banach  Space,  cp 
a  lower  semicontinuous  functional  on  E  having  bounded  convex 
level  sets,  and  K  a  closed  convex  set  in  E.  Then  cp  achieves 
its  infimum  on  K. 

Proof.  By  §3,  cp  is  weakly  lower  semicontinuous.  By  [1,  page  422, 
theorem  13]  K  is  weakly  closed.  Thus  the  set  M  =  {x  :  xeK,  cpCx)  <  c} 
is  bounded  and  weakly  closed.  By  [1,  page  425,  Corollary  8],  M  is 
weakly  compact.  Hence  cp  achieves  its  infimum  on  K.| 
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88.  Theorem.  Let  there  be  given  two  convex  functionals  defined 
on  the  conjugate  of  a  normal  linear  space  E: 

<p(f)  =  sup  {f(x>  -  X(x)3,  +(f)  =  sup  {f(y)  -  p(y)} 
xeX  yeY 

where  X  and  Y  are  subsets  of  E  and  X  and  p  are 

functionals  on  X  and  Y  respectively.  If  for  some  c^  >  inf  cp 

and  c^  >  inf  i|r  the  ^-level  set  of  cp  and  the  c^-level  set 

of  i|r  have  a  bounded  non-void  intersection,  then  each  functional 

achieves  its  infimum  on  each  non-void  level  set  of  the  other. 


Proof.  A  set  of  the  form  {f  :  f(x)  -  X(x)  <  c),  with  x  fixed  in 
E,  is  closed  in  the  weak*  topology.  Each  level  set  of  cp,  being  an 
intersection  of  such  sets,  is  weak*  closed.  Similarly  for  if.  This 
proves  that  cp  and  i|r  are  weak*  lower  semicontinuous .  Now  suppose  that 
the  set  of  f  satisfying  cp(f)  <  c^  and  \|r(f)  <  c 2  is  non-void  and 

bounded.  This  set  is  the  same  as  the  set  of  f  for  which 

max  {cp( f )  -  c^,  if( f)  -  c^}  <  0,  and  the  latter  is  therefore  bounded. 
Since  >  inf  cp  and  >  inf  ^ ,  there  is  an  c  >  0  such  that  the 
set  max  [cp(f)  -  c^ ,  f )  -  c^]  <  -  *  is  also  bounded  and  non-void.  By 

§4  the  set  of  f  for  which  max  {<p(f)  -  c^,  -  c^}  <  c  is  also 

bounded  for  any  c.  If  c^  <  c^  +  c  and  c^  <  +  c  then  the  set  of 

f  for  which  cp(f)  <  c^  and  f(f)  <  c^  is  bounded.  This  set,  then,  is 
weak*  closed  and  bounded,  hence  weak*  compact.  Hence  cp  and  if  achieve 
their  infima  there 
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Remark .  In  order  that  the  functional  tp  achieve  its  infimum  on 
E*  it  is  sufficient  that  one  level  set  of  cp  be  bounded  and  non-void. 

We  provide  next  some  examples  which  illustrate  how  existence  may 
fail  for  extremal  problems. 


§9 .  Example .  In  £p  with  p  >  1  define  X  =  {6n  :  n  =  1,2,...} 

where  6n  =  (0,... ,0,1,0,...).  Define  X  on  X  by  putting  X(6n)= 

n  where  q  1  +  p  1  =  1.  If  f  is  a  continuous  linear  functional 

on  iP  then  f(x)  =  E  a  x  where  ae-£q.  The  functional  X  does  not 

n  n 

possess  a  best  Tchebycheff  approximation  in  -£q .  Indeed,  for  the 
particular  sequence 


n  <  N 


n  >  N 


we  get  <p(f)  =  sup  |  f(x)  -  X(x)  |  =  sup  |a  -  n  1//q|  =  N  1//q.  Thus 

xeX  n  n  , 

inf  cp(f)  =  0.  But  to  attain  cp(f)  =  0  we  would  have  to  have  a  =  n  '  q 
f  n 

for  all  n,  and  then  <x^.£q.  In  this  example,  the  origin  does  not  lie 
in  the  relative  interior  of  the  convex  closure  of  XU  -  X,  so  that  the 
hypothesis  of  §16  below  is  not  satisfied. 


§10.  Example.  In  the  space  L  [0,1]  define  the  linear  functional 
1  x 

g(x)  =  J  tx( t)dt .  The  hyperplane  {x  :  g(x)  =  l}  has  no  point  closest 
0 

to  the  origin,  for  in  order  to  minimize  J|x(t)|dt  while  maintaining 
g(x)  =  1,  the  total  area  under  the  x-curve  would  have  to  be  piled  up  at 
the  point  1.  In  §14  below  a  simple  sufficient  condition  is  given  in  order 
that  a  linear  manifold  shall  contain  a  point  closest  to  the  origin. 


? 


§11.  Example.  Consider  a  Markoff  system  in  C[0,1]  which  is 

2n 

not  fundamental.  For  example  [x1  }.  Let  M  denote  the  closed  linear 
manifold  spanned  by  these  functions.  No  point  outside  M  has  a  closest 
point  in  M,  for  by  the  Tchebycheff  alternation  theorem  the  error  curve  for 
such  an  approximation  would  have  to  alternate  an  infinite  number  of  times 
between  +c  and  -e  ,  which  is  not  possible. 


§12.  Example.  In  f  let  X  denote  the  Hilbert  "cube,"  i.e. ,  the 
set  of  points  x  such  that  |x  |  <  l/n  for  all  n.  On  X  define  X 

CD 

by  X(x)  =  E  x  /Vn" .  The  series  is  absolutely  convergent  because  the  series 
,/2  n=l 

£  n converges.  Let  cp(f)  =  sup  |f(x)  -  X(x) | .  By  taking  f  to  be  a 

xeX 

sequence 


a  = 
n 


1/Vii 

0 


n  <  N 
n  >  N 


We  get  cp( f )  =  sup  |  £  —  |  <  £  n-^2.  Thus  inf  cp(f)  =  0.  But 

|x  |  <  -  ri>N  Vn  ri>N  f 

n  ~  n 

it  is  not  possible  to  achieve  <p(f)  =  0.  Indeed,  if  f  =  (a^,,..)  then 

clearly  a  V  —  for  some  n.  Take  then  x  =  —  6  to  show  |f(x)  -  X(x)  |  = 
"nr  n  n 

Vn 

i|a  -  — |  >0.  As  in  the  example  of  §9,  the  hypothesis  of  §16  is  violated, 
n  n  r 
Vn 


§13.  Example.  In  any  Banach  space  E  of  infinite  dimension,  let 

{x^}  be  a  linearly  independent  sequence  of  vectors  with  ||  xr  ||  \  0.  Put 

X  =  {x  }  U  £o}.  Then  X  is  compact.  Define  X.(x  )  =  VII  x  ||  and 

n  n  ii 

X(0)  =  0.  Then  X  possesses  no  best  Tchebycheff  approximation  from  E*. 

Indeed,  for  fixed  N,  if  we  put  f(x  )  =  X(x  )  for  n  <  N  and  f(x  )  =  0 

for  n  >  N  then  f  may  be  extended  linearly  to  an  element  of  E*.  But 

<p( f )  =  sup  |f(x)  -  \(x)|  =  ||  xN  II.  Hence  inf  cp(f)  =  0.  But 

xcX  w  feE* 


.1 
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if  tp(f  )  =  0  for  some  f  then  f  =  \  on  X,  and  then  f  is 
T  o  oo  ’  o 

unbounded  since  fQ(x g/ll  xnll)  =  11  II -*  oo.  As  in  the  example  of  §9  | 

the  hypothesis  of  §16  is  violated.  ! 

•  i 

§14.  Theorem.  Let  E  be  a  normed  linear  space  and  M  a  weak* 
closed  subset  of  E*.  Then  M  contains  a  point  of  minimum  norm. 

j 

Proof.  The  sets  Cf  :  ||  f  ||  <  c}  are  weak*  compact  by  [1,  page  424, 
theorem  2].  Hence  the  norm  in  E*  is  weak*  lower  semicontinuous.  Since 
M  is  weak*  closed,  each  set  {feM  :  ||  f  ||  <  c}  is  weak*  compact,  and 
hence  |j  f  ||  achieves  its  infimum.| 

§15.  Example.  As  an  illustration  of  an  extremum  being  achieved  we 
consider  a  problem  of  automatic  control.  There  is  given  a  system  of 
linear  differential  equations 

.  n  11 

(l)  x  (t)  =  £  A..(t)  x  (t)  +  2  B  (t)  u  (t)  +  c  (t)  (i  =  1 , . . . ,n) 

1  j=l  j=l  J  x 

or 

x  =  Ax  +  Bu  +  C 

in  which  A  and  B  are  nXn  matrices  depending  continuously  on  te[0,l], 
and  x(t)  ,  u(t),  euid  c(t)  are  n-vectors.  It  is  assumed  that  c(t)  is 
continuous.  The  control  problem  consists  in  finding  a  control  u(t)  such 
that  the  differential  equations  above ,  with  prescribed  initial  and  terminal 
values  x(0)  and  x(l)  ,  will  have  a  solution  x(t) ,  and  such  that  under 
this  restriction  the  integral 
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(2) 


J 

0 


u2(e)]1//2dB 

II 


will  be  minimized.  Since  we  wish  to  permit  the  u^  to  be  generalized 
functions ,  it  is  more  convenient  to  rephrase  the  problem  after  first 
passing  to  the  explicit  solution  of  the  initial  value  problem.  To  this 
end,  let  3(t)  be  the  matrix  of  fundamental  solutions  of  (1)  such  that 
3(0)  is  the  identity  matrix.  Then  the  initial  value  problem  has  the 
solution 


x.(t)  =  £  3.  .(t){x.(0)  +  P  £  (s)[B  (s)  iu(s)  +  c  (s)]ds} 

1  j=l  ^  0  k=l  JK  JK  K  K 

t 

x(t)  =  3(t){x(0)  +  J  3  (s)[B(s)  u(s)  +  c(s)]ds) 

0 


Let 

x.(l) 

3 

(3) 


u.(s)ds  =  dv.(s).  The  condition  that  the  prescribed  terminal  values 
3  3 

be  achieved  is  that 
1  , 

J  3  1  (s)B(s)dv(s)  =  o 
0 


where  a  is  a  numerical  n-tuple  given  by 

i  1  i 

a  =  3_1(l)x(l)  -  J  I  (s)  C(s)ds. 

0 

Now  let  £  denote  the  n-fold  direct  sum  of  C[0,1],  An  element  of 
may  be  identified  with  an  n-tuple  (v^,...,v  )  where  each  v^  is  a 
function  of  bounded  variation  on  [0,1],  For  v  =  (v  ,... *vn)«£*  and 
y  =  (y1,...,yn)e^  we  set 
n  1 

<v,y>  =  s  J*  y  (s)dv  (s) 
j=l  0  J  J 
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Now  for  i  =  l,...,n  let  Y^  be  a  point  in  f  with  components 

Then  equation  (3)  takes  the  form 

(v.Y^)  =  a±  (i  =  1,...  ,n) 

From  this  we  see  that  v  is  constrained  to  lie  on  the  intersection  of 
n  hyperplanes  in  <}*  ,  whose  gradients  are  from  The  set  of  all  such 

v  is  therefore  a  weak*  closed  linear  manifold. 

Now  let  $  be  normed  as  follows:  ||  x  ||  =  sup  Jz  x?(t)  .  This 

CKt<l  1 

norm  on  6  induces  a  norm  on  £* ,  and  we  shall  show  that  for  a  linear 
functional  v  of  the  form 

1 

<v,x>  =  Z  J  x.(s)  u . ( s ) ds 
i  0  1  1 

the  norm  ||  y  ||  is  precisely  the  integral  (2). 


In  fact ,  by  the  Cauchy-Schwartz  inequality  for  n-tuples ,  we  have 


v  ||  =  sup  <v  ,x> 

xe#  ||  x  ||=1 


j. 

=  sup  f  Z  x.  (s)u. (s)ds 
11x11=10  i  1  1 

<  sup  r  Jz  x2(s)  Jz  u2(s)  ds 
"11x11=10 

<  J  Jz  u?(s)  ds 
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On  the  other  hand,  we  can  take  as  a  particular  choice  for  x  the 
function  of  norm  1  whose  components  are 

x.(s)  =  u  (s)/Jz  u^(s) 

Then  ||  v  ||  >  (v  ,x)  =  u?(s)  ds. 

0  1 

If  the  scope  of  the  problem  is  enlarged  so  that  the  controls  are 
differentials  of  functions  of  bounded  variation  then  the  existence  of 
optimal  controls  is  guaranteed  by  the  simple  theorem  of  §14. 

In  the  next  theorems  we  are  concerned  with  an  abstract  problem  of 
Tchebycheff  approximation.  Given  a  set  X  in  a  linear  topological  space 
E  and  a  bounded  functional  \  on  X  we  seek  an  element  feE*  for 
which  the  expression 

cp( f )  =  sup  |f(x)  -  X(x)  | 
xeX 

is  an  absolute  minimum.  If  such  an  f  exists ,  it  is  termed  a  "best 
Tchebycheff  approximation  to  X."  This  problem  encompasses  the  familiar 

l 

problems  of  approximating  functions  by  linear  families  of  other  functions. 
This  will  be  mentioned  again  later.  We  begin  with  an  existence  theorem. 
The  notation  [X]  denotes  the  linear  subspace  spanned  by  a  set  X.  The 
convex  hull  of  X,  denoted  by  $(X)  is  the  set  of  all  finite  linear 
combinations  S  Q  x±  where  x^X,  >  0,  S  fl.  =  1,  The  convex 

closure  of  X  is  the  closure  of  the  convex  hull ,  and  is  denoted  by 
$(X).  We  mean  by  the  relative  interior  of  X  its  interior  relative  to 


the  least  linear  manifold  containing  X. 
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§16.  Existence  Theorem  for  Tchebycheff  Approximation.  Let  E 
be  a  Banach  space  and  X  a  subset  of  E.  In  order  that  each 
bounded  function  on  X  possess  a  best  Tchebycheff  approximation 
in  E*  it  is  sufficient  that ,  in  the  relative  topology  of  [X]  , 

0  be  interior  to  the  convex  closure  of  XU  -  X. 

Proof.  The  space  [X]  is  a  normed  linear  space  (possibly  incomplete) 

and  [X]*  is  a  Banach  space.  We  begin  by  showing  that  the  functional 

9  defined  on  [X]*  by  the  equation  cp(f)  =  sup  |f(x)  -  X(x)  |  achieves 

xeX 

its  infimum.  By  the  remark  of  §8,  it  suffices  to  prove  that  each  level 

set  of  cp  is  bounded.  Suppose  cp(f)  <  c.  Then  |f(x)  -  X(x)  |  <  c  for 

all  xeX.  Thus  |f(x)|  <  b  for  an  appropriate  b  .  This  inequality 

is  valid  also  for  xe  -  X.  By  linearity  the  inequality  remains  true  for 

xe  ft  ( X  U  -  X)  ,  and  by  continuity  for  xe  X  U  -  X) .  Thus  f  is  bounded 

by  b  on  a  sphere,  and  *his  makes  f  bounded  by  a  constant  independent 

of  f.  Thus  cp  achieves  its  infimum  on  [X]*  ,  say  at  fQ.  By  the 

Hahn-Banach  theorem ,  fQ  may  be  extended  to  an  element  of  E*  without 

changing  cp(fQ).  On  the  other  hand,  any  element  of  E*  becomes  an 

element  of  [X]*  when  restricted  to  X,  Hence  f  (extended)  solves 

o 

the  minimization  problem. | 

§17.  Characterization  Theorem.  Let  X  be  a  bounded  subset  of 

a  locally  convex  space  E,  and  X  a  functional  on  X  which 

is  bounded  below.  In  order  that  a  point  fQeE*  minimize  the 

expression  cp(f)  =  sup  ff(x)  -  X(x)}  it  is  necessary  and  sufficient 
xeX 
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that  Ot  Cl  $X ,  where  X  =  {xeX  :  f  (x)  -  X(x)  >  cp( f  )  -  e}. 

«>0  *  *  0  0 

Proof.  If  04  6(X  )  then  by  the  separation  theorem,  there  exists  an 

_____  g 

heE*  such  that  inf  h(x)  ■  6  >  6.  Let  c  be  a  positive  number  such 
l*c$(X  ) 

that  -  ch(x)  <2*  ^1  xeX-  Then  cp(fQ-ch)  <  cp(fo).  Indeed,  for 

xeX  we  have  f  (x)  -  ch(x)  -  X(x)  <  cp(f  )  -  c6,  and  for  xeX  ~  X  we 

have  f  (x)  -  ch(x)  -  \(x)  <  cpC f  )  -  e  -  ch(x)  <  cp(f  )  -  e/2. 

O  0  o 

Tor  the  converse,  suppose  that  f  does  not  minimize  tp,  Then  there 
is  an  heE*  and  an  e>0  such  that  cp( fQ  -  h)  +  2e  <  q>(fQ).  Let  y  be  a 
point  of  Xg.  Then  cp(fQ)  <  fQ(y)  -  X(x)  +  e,  whence  fQ(y)  -  h(y)  -  X(y) 

<  cp(f  -  h)  <  cp( f  )  -  2e  <  f  (y)  -  X(x)  -  e.  Thus  -  h(y)  <  -  e,  and  0 
cannot  lie  in  the  convex  closure  of  Xg.J 

The  analogous  theorem  for  Tchebycheff  approximation,  in  the  real  or 
complex  case  may  be  stated  as  follows : 

§18.  Theorem.  Let  X  be  a  bounded  subset  of  a  locally  convex 

space  E  over  the  real  or  complex  field,  and  X  a  bounded 

functional  on  X.  A  necessary  and  sufficient  condition  that  an 

element  feE*  shall  minimize  the  expression  cp(f)  =  sup  |f(x)  -  X(x) | 

xeX 

is  that  Oe  f|  fiX  ,  where  X  =  {r(x)  .(x)  :  |r(x)|  >  <p(f)  -  «}  and 
e>0  e  6 

r  =  f  -  X. 

§  19 .  Lemma  Let  { A^}  be  a  decreasing  sequence  of  compact  sets 
in  a  locally  convex  space.  Then  fiflA^  = 

Proof.  Put  A  =  OA  .  Since  OfiA  is  a  closed  convex  set  containing  A, 

■  ~*  n  n 
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it  contains  ftA  also. 

For  the  reverse  inclusion,  note  first  that  S3 A  is  the  intersection 
of  all  closed  half  spaces  containing  A.  It  will  therefore  suffice  to 
prove  that  if  a  half  space  {x  :  f(x)  <  c}  contains  A  then  it  contains 
HfcA  Given  e,  there  corresponds  an  m  such  that  A^  cr  {x  :  f(x)  <  c  +  e]. 
Indeed  in  the  contrary  case ,  we  could  find  a  sequence  x^  with  the 
property  x^eA^  {x  :  f(x)  >  c  +  e},  and  any  cluster  point  x  of  this 

sequence  would  lie  in  A  but  not  in  {x  :  f(x)  <  c}.  Thus  the  half  space 

{x  :  f(x)  <  c  +  e}  contains  A  ,  hence  fcA^,  and  finally  flft  An<  Since 
this  is  true  for  every  e,  the  proof  is  complete.  This  argument  by  R.  T. 
Rockafellar  replaces  our  earlier  and  clumsy  proof. | 

§20.  Theorem.  Let  X  be  a  non-void  compact  set  in  a  (possibly 

complex)  locally  convex  space  E,  and  \  a  continuous  functional 

on  X.  In  order  that  an  element  feE*  shall  minimize  the 

expression  cp(f)  =  sup  |f(x)  -  X(x) |  it  is  necessary  and  sufficient 
xeX 

that  0  lie  in  the  convex  closure  of  the  set  [r(x) *x  :  xeX,|r(x)| 

=  cp(f)},  where  r  =  f  - 

Proof.  1.  By  §18 ,  the  necessary  and  sufficient  condition  on  f  is  that 

Oe  fl  fix  where  X  =  {r(x)*x  :  |r(x)|  +  e  >ep(f)).  Since  \  is  contin¬ 
ent)  ®  ®  _ 

uous ,  X  is  compact.  By  the  lemma,  nfix  =finx  .  But  nx  =  x  .■ 

0  €6  CO 

Proof  2.  A  direct  proof  using  the  separation  theorem  is  also  possible. 

Assume  first  that  04ftXQ.  Then  cp(f)  >  0.  By  the  separation  theorem, 

there  exists  hsE*  such  that  a  =  inf  R[h(x)]  >  0.  Let  Z  =  ,{:xeX  : 

x«fi(X  ) 
o 
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|  r(x)  |  >  jj  tp(f)  and  R[r(x)  h(x)]  >  ~  o}.  Since  Z  is  open  in  X,  the 

set  Y  =  X  ~  Z  is  compact.  Consequently  the  supremum  of  |r(y)|  is 

attained  on  Y,  say  at  yQ.  If  p  *  |r(yQ)l  =  cp(f)  then  r(yQ)-yoeXo 

and  yQ*Z,  contradicting  the  choice  of  yQ.  Hence  p  <  cp( f ) -  Now 

let  p  =  1  +  max|h(x)|  and  let  0  <  6  <  j  ot/p2.  If  xeZ  then 
xeX 

| r(x)  -  ©h(x)|*  =  |r(x)|2  +  ©2|h(x)|2  -  26  R[h(x)  r(x)]  <  |r(x)|2  +  ©2p2  - 
6a  <  Ccp(f)]2  -  j  a©.  If  0  <  ©  <  p-1[ep(f)  -  p]  then  for  xeY, 

| r(x)  -  ©h(x) |  <  | r(x) |  +  ©|h(x)|  <  p  +  ©p  <  cp(f).  Consequently  for 
some  ©,  cp(f  -  Sh)  <  cp(f). 

For  the  converse,  assume  that  cp(f  -  h)  <  9(f).  Then  |(f  -  h)(x)-  X(x)  |  < 
|f(x)  -  X(x) |  for  xeS  =  {xeX  :  |r(x)|  =  cp(f)}.  Hence  |(f  -  h)(x)  -  X(x)|2  = 

| r(x) | 2  +  |h(x)|2  -  2ft[h(x).r(x)]  <  |r(x)|2,  and  R[h(x)-r(x)]  >~  |h(x) |2. 
Since  h(x)  does  not  vanish  on  S  and  since  S  is  compact,  R[h(x) .r(x) ] 
is  bounded  away  from  0  on  S ,  and  consequently,  045Xo>  This  Theorem 
was  given  in  the  real  case  in  a  research  announcement, Bulletin  of  the  Am. 

Math.  Soc.  [68,  (1962),  449-450].  | 

§21.  Definition.  The  cone  of  a  set  Y  consists  of  the  origin 
together  with  all  the  positive  multiples  of  points  in  Y.  Thus 
in  particular  the  cone  of  the  void  set  is  £ 0] .  The  cone  of  Y 
is  denoted  by 


§  22 .  Lemma .  In  a  linear  topological  space  the  cone  of  a  closed 
and  bounded  set  not  containing  0  is  closed. 
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Proof.  Let  Y  be  such  a  set  and  E  the  space.  If  ^(Y)  is  not 

closed  then  there  is  a  point  ueE  ~<^(Y)  such  that  every  neighborhood 

of  u  meets  ^(Y).  Then  to  each  neighborhood  a  of  0  there  will 

correspond  u  e  (u  +  a)  fi  i^(Y).  We  may  write  u  =  X  y  where  X.  >  0 
a  a  a  a  a  - 

and  y  eY.  By  passing  to  a  subnet  we  nay  suppose  that  X^  converges, 
possibly  to  +  oc.  In  the  latter  case,  ya  -*  0  contradicting  the 
hypothesis  O^Y.  If  X  -»  0  then  u&  -*  0  because  Y  is  bounded.  Since 
u  /  0  this  possibility  is  ruled  out  also.  Consequently,  X^  -*  X  with 
0  <  X  <  <d.  Hence  yft  -•  u/X.  Since  Y  is  closed  u/XeY,  contradicting 

uWY).| 

§23.  Lemma.  Let  Y  be  a  closed  and  bounded  convex  set  having 
a  closed  cone  in  a  locally  convex  space,  and  let  X  be  a  compact 
convex  set  disjoint  from  the  cone  of  Y.  Then  there  exists  a 
continuous  linear  functional  f  such  that 

sup  f(x)  <  0  <  inf  f(y) 
xcX  yeY 


Proof.  By  the  ordinary  separation  theorem,  there  exists  a  continuous 

linear  functional  h  such  that  inf  h(y)  >  0.  Since  ^(Y)  is  closed, 

yeY 

there  exists  a  continuous  linear  functional  g  such  that 


sup  g(x)  <  0  <  inf  g(y) 
xcX  ye$Y) 

Now  let  0  <  X  <  inf  C-g(?)]  7  sup  1  +  |h(x)| ,  and  define  f  =  g  +  Xh. 

£eX  xeX 

We  have  then  for  xeX,  f(x)  =  g(x)  +  Xh(x)  <  g(x)  +  X[1  +  |h(x)|]  <  g(x)  + 

inf  [-g(0]  <  0.  Since  X  is  compact  and  f  is  continuous,  sup  f(x)  <  0. 
?eX  xeX 
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On  the  other  hand,  inf  f(y)  =  inf  Cg(y)  +  Xh(y)]  >  inf  Xh(y)  >  O.B 
yeY  yel  y*Y 

§24.  Existence  Theorem.  Let  X  and  I  be  subsets  of  a 

normed  linear  space  E.  Let  X  and  p  be  bounded  functionals 

on  X  and  Y  respectively.  If,  in  the  relative  topology  of 

[XUY] ,  0  is  interior  to  the  convex  closure  of  XUY  then  the 

functional  cp( f )  =  sup  [f(x)  -  X(x)]  achieves  its 
xeX 

infimum  on  the  set  K  =  {feE*  :  sup  Cf(y)  -  p(y)]  <  O) . 

y«Y 

Proof.  We  proceed  as  in  §16.  For  any  constant  c  the  set  S  of 

feCXlJY]*  for  which  sup  [f(y)  -  p(y)]  <  0  and  sup  [f(x)  -  X(x)]  <  c 
yeY  xeX 

is  bounded.  Indeed,  if  feS  then  because  of  the  boundedness  of  X  and 
p,  f(z)  <  k  for  some  k  and  all  zeXUY.  This  inequality  remains  true 
for  zefc(XUY)  and  hence  on  a  sphere  about  0.  Thus  S  is  bounded.  By 
familiar  arguments,  S  is  compact  in  the  weak*  topology  of  [XUY]*, 
and  tp  is  weak*  lower  semicontinuous ,  An  element  of  [XUY]*  which 
minimizes  cp  may  be  extended  by  the  Hahn-Banach  theorem  to  E*.| 


Remark .  It  is  only  necessary  to  assume  that  for  some  Xq  C  X  and 

Y  C  Y ,  p  is  bounded  on  Y  ,  X  is  bounded  on  X  ,  and  0  is  in  the 
o’  o’  o’ 

interior  of  *(X  UY  )  relative  to  [XUY]. 
o  o 


Characterization  Theorem  for  Convex  Programming 


a  locally  convex  space,  X  a  bounded  subset  of  E,  and  Y  a 
compact  subset  of  E  with  (Y).  Let  X  be  a  functional  on 


X  which  is  bounded  below.  Let  p  be  a  lower  semicontinuous 
functional  on  Y.  Put  K  =  {feE*  :  f(y)  <  p(y)  for  all  yeY) 
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and  tp( f )  =  sup  {f(x)  —  X(x)  ;  x<X} .  In  order  that  a  point 
fQ  of  K  minimize  tp  on  R  it  is  necessary  and  sufficient 
that  for  each  e  >  0,  £5(-Y  )n£(X  )  A  $  where  Y  =  {yeY  : 
fQ(y)  =  y(y)}  and  Xg  =  {xcX  :  f^(x)  -  X(x)  >  «p(f  )  -  «}. 

Proof.  (Sufficiency)  Suppose  that  f  does  not  minimize  cp  on  K.  Then 

for  some  heE*,  fQ  -  heK  and  cp( fQ  -  h)  <  cpCfQ) .  Select  «  >  0  such  that 

-  h)  <  tp(fQ)  -  2e .  For  yeYQ  we  have  (f  -  h)(y)  <  p(y) , 

whence  h(y)  >  0.  This  inequality  persists  if  y  ranges  over  £$(Y  ).  For 

o 

xeX,  we  have  (fQ  -  h)(x)  -  X(x)  <  cp( fQ  -  h)  <  cp( fQ)  -  2e  <  fQ(x)  -  X(x)  -  e, 
whence  h(x)  >  e.  This  inequality  persists  if  x  ranges  over  5(Xg).  Thus 

the  sets  -Yq )  and  Sj ( xp  are  disjoint, 

(Necessity)  Suppose  that  the  sets  <Z6(-Y  )  and  fi(X  )  are  disjoint 

o  e 

for  some  e  >  0.  By  §23,  there  exists  an  heE*  and  constants  a  and  p 
such  that 

h(y)  <  2a  <  0  <  p  <  h(x) 

for  all  yeJj(-Y  U{ O] )  and  all  xe£(X  ).  Since  XUY  is  bounded  there 
o  € 

exists  a  number  k  such  that  |h(x) |  <  k  for  all  xeXUY.  Now  let 

Y*  =  {yeY  :  h(y)  >  -  a}.  Y*  is  then  an  open  set  in  Y  containing  Y  . 

Since  Y  ~  Y*  is  compact  and  contains  no  points  of  Yq,  the  number 

Y  =  max  {f  (y)  -  >i(y)} 
yfY-Y*  0 

is  negative.  Select  a  positive  number  t  such  that  2tk  <  max  {e ,  -  y). 

We  are  going  to  show  that  f  -  th  is  a  point  of  K  yielding  a  lower 
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value  of  cp  than  cp(fQ).  For  yeY*  we  have  ( f q  -  th)(y)  -  p(y)  < 

-  th(y)  <  0.  For  yeY~Y*  we  have  (fQ  -  th)(y)  -  yCy)  <  Y  +  tk  <  <  0. 

Thus  f  -  thcK,  For  xcX  we  have  (f  -  th)(x)  -  X(x)  <  cp(f  )  -  th(x)  < 

cp(f  )  -  tp.  For  xeX~X  we  have  (f  -  th)(x)  -  X(x)  <  cp(f  )  -  e  -  th(x)  < 
To  e  o  —to  — 

<p(fQ)  -  c  +  tk  <  qj<  fQ)  -  .  Hence  cp(  f  Q  -  th)  <  cp(fQ).| 

Remark .  The  hypothesis  O^fi(Y)  may  be  replaced  by  the  hypothesis 
that  (Y)  is  closed. 

§26.  Corollary.  If,  in  the  above  theorem,  E  is  complete,  X 

is  compact,  and  X  is  lower  semicontinuous ,  then  the  necessary 

and  sufficient  condition  on  f  is  that  <2fi(-Y  )flfi(X  )  shall 

o  o  o 

be  non-void. 

Proof.  From  the  theorem,  the  necessary  and  sufficient  condition  on  f 

is  that  for  each  e  >  0  there  exist  a  point  vg  in  £fc(io)n5(xe). 

Since  83 (Xg)  is  compact  [2,  page  8l ,  corollary],  the  set  [v(  :  c  >  0} 

has  a  point  of  accumulation,  v.  Clearly  ve  f|  83X  .  But  by  §19, 

e>° 

n«3x  =  finx  =  fix  ■ 

e  e  o  ■ 

§27.  Example.  In  the  linear  space  C[0,1]  we  introduce  the 

norm  ||  x  ||  =  sup  (t  +  l)|x(t)|,  which  is  topologically  equivalent  to 
t 

the  usual  norm.  Consider  the  problem  of  minimizing  ||  f  ||  in  the 
conjugate  space  under  the  constraint  f(I)  =  1  where  I  denotes  the 
function  identically  1  on  [0,1].  The  theorem  of  §25  may  be  applied 
to  prove  that  a  solution  is  given  by  IQ(x)  =  x(l).  To  this  end,  let 
X  denote  the  unit  sphere  in  C  and  let  Y  =  {*l}.  We  set  p(*I)  =  il 
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and  \(x)  =  0.  Then  K  =  {f  :  f(I)  =  l}  and  cp(f)  =  ||  f  || .  The  set 

Y  is  C±I)  and  the  set  X  is  {xeC  :  x(l)  >  1  -  •  }.  Since 

o  e  ~ 

IeY  HY  ,  the  condition  of  the  theorem  is  met,  and  f  is  a  solution. 

§28.  Theorem.  Let  E^  and  E^  be  Banach  spaces.  Let  X 
be  a  subset  of  E  such  that  0eint5(XU  -  X).  Let  A  be  a 
bounded  map  of  X  into  E*.  Then  A  has  a  best  Tchebycheff 
approximation  by  an  element  of  B(E^,E*). 

Proof.  Define  the  T-topology  in  B(E^,E*)  by  saying  that  L^  -» 

L  iff  ^y,L^x^  -*  (y,Lx)  for  all  xeE^  and  all  yeE^.  We  are  going  to 

show  that  the  function  q>(L)  =  sup  ||Lx  -  Ax  ||  achieves  its  infimum  in 

x(X 

B(E^,E*).  It  will  suffice' to  show  that  cp  is  T-lower  semicontinuous 

and  that  each  set  Mc  =  {LeBCEpE*)  :  cp(L)  <  c}  is  T-compac't.  That  Mc 

is  T-closed  is  quite  obvious,  and  thus  cp  is  T-lower  semicontinuous. 

Now  M  is  norm  bounded  because  if  LeM  then  ||  Lx  -  Ax  ||  <  c  for 
c  c  “ 

all  xeX  whence  ||  Lx  ||  <  c'  for  all  xeX.  This  inequality  remains 
true  for  xe?j(XU  -  X)  and  thus  in  a  sphere  about  0.  Thus  [I  L  ||  is 
bounded  by  a  number  depending  only  on  c.  Since  is  norm  bounded 

and  T-closed,  we  may  apply  Corollary  3  of  [2,  chapter  4,  page  65]  to 
conclude  that  is  T-compact.Jj 

§29.  Lemma.  Let  E  and  F  denote  Banach  spaces.  Let  X  be 
compact  in  E  and  Y  compact  in  F.  In  order  that  there  exist 
a  bounded  linear  transformation  A  :  F  -»  E*  such  that  (x,Ay)  >  0 
for  all  xeX  and  yeY,  it  is  necessary  and  sufficient  that  the 
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convex  closures  of  X  and  T  be  disjoint  from  0. 

Proof.  If  (x,Ay)  >  0  for  all  xeX  and  yeY  then  by  compactness, 
x,Ay>  >  e  for  some  <  >  0.  This  remains  true  for  xe&X  and 
y«5l.  Consequently  0*$X  and  0*  gjY. 

Conversely,  suppose  0* £  X  and  0*5  7.  By  the  separation  theorem, 
there  exists  ueE*  and  veF*  such  that  (x,u)  >  0  for  all  xeX  and 

<y,v)  >0  for  all  yeY.  Define  A  :  F  -*  E*  by  putting  <x , Ay}  =  (u,x>(v,y> 

for  arbitrary  xeE  and  yeF.  Clearly  A  is  a  bounded  linear  transformation 

satisfying  (x,Ay}  >  0  for  xeX  and  yeY. | 

§30.  Theorem.  Let  X  be  a  compact  set  in  a  Banach  space  E 

and  $  a  continuous  map  of  E  into  Hilbert  space.  In  order 

that  a  bounded  linear  operator  A  from  E  into  the  Hilbert 

space  shall  minimize  the  expression  A(A)  =  sup  ||  Ax  -  cpx  ||  it 

xeX 

is  necessary  and  sufficient  that  0  lie  in  the  convex  closure 

of  X  =  {x«X  :  ||  Ax  -  cpx  ||  =  A(A)}  or  of  {Ax  -  cpx  :  xeX  }. 
o  T  T  o 

Proof.  Put  Rx  =  Ax  -  cpx.  If  A(A)  is  not  a  minimum  then  for  some  linear 

2  2 

operator  B,  A(A-B)  <  A(A).  Thus  for  xeXQ,  ||  Ax  -  cpx  -  Bx  ||  <  ||  Ax  -  cpx  || 

p 

whence  -  2(Rx,Bx)  +  ||  Bx  ||  <0  and  (Rx,Bx)  >  0.  By  the  lemma,  0  is 
disjoint  from  the  convex  closures  of  the  point  sets  {Rx  :  xeX^}  and  Xq. 

For  the  converse,  suppose  that  0  is  disjoint  from  the  convex 
closures  of  the  sets  {Rx  :  xeXQ}  and  Xq.  By  the  lemma,  there  exists  a 
linear  operator  B  such  that  (Rx,Bx)  >  0  for  all  xeXQ.  Since  Xq  is 

compact,  the  number  e  =  min(Rx,Bx)  is  positive.  Put  e  =  max  ||  Bx  || . 

xeX  xeX 

o 
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Define  X^  =  {xcX  :  (Bx,Rx)  >  II  Rx  ||  >  cjA(A)}.  X^  is  open  in  X 

and  contains  Xq.  Consequently  X  ~  X^  is  a  compact  set  containing  no 

points  of  Xq.  Consequently  ||  Rx  ||  has  a  maximum,  e,  on  X  ~  X1  such 

that  e  <  A(A).  Let  0  <  X  <  e../e2  and  0  <  X  <  ~  -  .  We  are 

12  2*2 

going  to  prove  A(A  -  XB)  <  A(A).  For  xeX^  we  have  ||(A  -  XB)x  -  tpx  ||  = 
||  Rx  ||2  -  2X(Rx ,Bx)  +  X2||Bx|l2  <  ||Rx||2  -  X«1  +  X2e2  <  ||Rx  ||2  +  Xe2(X--i). 
For  x«X~X^  we  have  ||(A  -  XB)x  -  tpx  ||  <  ||Rx||  +  X||Bx  ||  <  e  +  Xe^  < 
e  +  |[A(A)  -  e]  <  A(A) . | 

In  the  next  theorem  we  consider  the  problem  of  non-linear  Tchebycheff 
approximation  in  an  abstract  setting.  Let  E  be  a  reflexive  Banach  space 
over  the  real  field,  and  let  T  be  a  compactum.  Let  f  be  a  map  of 
EXT  to  the  field,  continuous  in  x  and  t  separately.  We  assume  that 
f  has  a  Frechet  derivative  f'  with  respect  to  the  first  variable  x, 
that  (f'(x,t)  :  t«T}  is  equicontinuous  and  that  f'  is  continuous  in  t. 
The  points  xeE  for  which  the  expression 

A(x)  =  sup  |f(x,t) | 
t«T 

is  (locally)  a  minimum  are  partially  characterized  by  the  following 
theorem.  Set  T^  =  [teT  :  |f(x,t)|  =  A(x)}. 

831.  Theorem.  If  a  point  x«E  is  a  local  minimum  point  of  A 
then  the  origin  of  E*  lies  in  the  convex  closure  of  the  set 
(f(x,t)f'(x,t)  :  teTxJ. 

Proof.  Suppose  that  0  is  not  in  the  convex  closure  of  the  cited  set. 

By  the  separation  theorem  there  exists  zeE**  =  E  such  that 
f(x,t)<z,f’(x,t)>  >  0  for  all  teTx> 


With  no  loss  of  generality  we  may 
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assume  that  ||  z  ||  =  1.  Since  T^  is  compact,  there  is  an  e  >  0 
less  than  all  the  numbers  f (x ,t)(z ,f ' (x,t))  for  teT^.  By  the 
continuity  properties  of  f  and  f'  we  may  find  a  6  >  0  such  that 
for  all  ||?  ||  <  6,  the  following  two  conditions  are  satisfied: 

II  f'(x  +  ?,  t)  -  f '  (x,t)  ||  <  ^e  (teT) 

2f(x,t)<z,f'(x  +  ?,t)>  >  c  (t«T  ) 

Now  let  =  {teT  :  |f(x,t)|  >  ^A(x)  and  f(x,t)(z,f'(x,t)>  >  e).  Clearly 

is  an  open  set  containing  T^.  Thus  =  T  ~  T  is  a  compact  set 

containing  no  points  of  T  .  Consequently,  the  number  p  =  sup  |f(x,t)|  is 

X  teT 

less  than  A(x).  Select  X  in  accordance  with  the  inequalities 

(1)  0  <  X  <  6 

(2)  XQ  <  A(x)  -  p  where  Q  =  |  +  sup  |f'(x,t)| 

?  teT 

(3)  XQ^  <  e  . 

We  are  going  to  prove  that  A(x  -  Xz)  <  A(x).  For  teT^  we  have 

I f ( x  -  Xz,t)|2  =  |f(x,t)  -  X<z,f'(x  -  0Xz,t)>|2  =  | f(x,t) |2  - 

2Xf(x,t  )<z,f(x  -  6Xz,t)>  +  X2|<z,f'(x  -  OXz,t)>|2  <  A2(x)  -  2Xe  + 

2  2  2 

X  Q  <  A  (x)  +  X[-2e  +  «].  On  the  other  hand,  for  teT^  we  have 
|f(x  -  Xz,t)|  <  |  f  (x  ,t )  |  +  X|(z,f'(x  -  OXz  ,t))|  <  p  +  XQ  <  p  +  A(x)-p  = 

A(x) . | 

Remark .  For  this  theorem  the  function  f  may  be  defined  on  S  X  T 


(where  S  is  an  open  subset  of  E)  instead  of  on  EXT. 
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